#
# Oliver Soop oliversoop@gmail.com
# 24. February  2014
#
This script will create an edgelist from the files produced by other scripts. This means that the script will take the URL files and relations file as inputs.
All of the different values will be stored into uniform identifier namespace.

In this script there are following Python scripts files:
	configuration.py - Here you can set database connection settings and different processing thresholds and values
	ArticleRelationMapper.py - This script is to coordinate processing URLs and relations found in Articles. Exact information available in the corresponding file.
	RelationMapper.py - This script is to coordinate processing URLs and relations found in Twitter Tweets, different Facebook entities and article comments. Exact information available in the corresponding file.
	CheckArticleURL.py - This script will check if one URL references any articles in the database and if, returns the identifiers of the articles. Exact information available in the corresponding file.
	CheckFacebookURL.py - This script will parse Facebook post or comment identifier from the URL. Exact information available in the corresponding file.
	CheckTwitterURL.py - This script parses Twitter Tweet identifier from the URL. Exact information available in the corresponding file.
	IDGenerator.py - Edgelist has to have identifiers from same namespace, this script will check for no collisions and save new identifiers. Exact information available in the corresponding file.
	InputFilePreprocessor.py - This script preprocesses the input file for already processed entries. Not very efficient. Exact information available in the corresponding file.
	MainScript.py - This script coordinates all the work of other scripts.
	URLPreprocessor.py - This script will preprocess the URL so that the match in database can efficiently be found. Exact information available in the corresponding file.

Necessary libraries:
	Python v2.7
	MySQL database (no specific version)
	MySQL Python Connector

Before running the script:
	Create table id_mapping, using id_mapping_table.sql
	Preprocess the article database entries, using article_database_preprocessing.sql
	Set database and other configuration in configuration.py
	Set file locations in MainScript.py
To run the script, run MainScript.py